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ABSTRACT 
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considered in this paper, item information in the two models can be 
expressed in a closed form. Also, it is shown that for a random 
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distribution, item information in all three models takes smaller and 
smaller values. Results from a simulation study of tests with 5 and 
20 items demonstrate these features numerically, six tables present 
the results of the simulation study, and one graph illustrates item 
information in the marginal model. (Author/SLD) 
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Abstract 

Fisher ' s information measure for the item' difficulty 
parameter in the Rasch model as well as its marginal and 
conditional formulations is investigated. It is shown that 
expected item information in the unconditional model equals 
information in the marginal model, provided the assumption of 
sampling examinees from an ability distribution is nade. For 
the logistic ability distribution considered in this paper, 
item information in the two models can be expressed in a 
closed form. Also, it is shown that for a random examinee 
expected item information in the conditional model is always 
less than in the other two models, albeit that the difference 
quickly decreases with an increase in test length. If the 
distribution of the item difficulties in the test deviates 
more and more from the ability distribution, item information 
in all three models takes smaller and smaller •'^.lues. Results 
from a simulation study demonstrate these features 
numerically. 

Keywords: Item Response Theory. Rasch Model. Fisher's 
Information 
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Item Information in the Rasch Model 

Consider a test consisting of I dichotomously scored items 
and let N examinees t^l^e the test. Let the random variables 

(rv) Xji (j=l,...,N; i=l I) take the value 1 if examinee 

j answers item i correctly and 0 otherwise. As usual, local 
independence and the assvunption of examinees answering the 
items independently of one other is made throughout. For the 
form of the item response function, i.e.. the probability 
that an item is answered correctly as a function of the 
(unidimensional) latent ability, the one-parameter logistic 
is chosen. In other words, we assume that the Rasch (1980) 
model holds. To be more specific, let the item difficulty 
parameters be denoted byo^. . . ., Oj and the examinee ability 
parameter by 9^ . then 

(1) PCXji = l;ej.Oi) = exp(ej-<Ji)/(l + expOj-Ci)] . 

where -o© < 9 j , < +« . 

In this paper, the main interest lies in obtaining 

information about the item difficulties 0^ Oj, whereas 

the abilities 9^, 9jj will be considered as nuisance 

parameters. It will be shown that,, depending on the way the 
nrlsance parameters are treated, different forms of Fisher's 
information measure for the item parameter can be defined . 
The objective is to compare these information measures. The 
results of the comparison are relevant to the test 
constructor who wants to estimate item parameters under the 
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most informative model. Howover. a direct comparison of the 
different information measures is, for obvious reasons, not 
possible. Therefore, the comparison will be made either for 
t&e experiment of replicated item administrations to a fixed 
examinee or for the experiment of an examinee randomly 
sampled from a certain ability distribution. The reason for 
the choice of the experiments is elucidated below. For these 
experiments . an information analysis can be worked out either 
analytically or niunerically in a fairly easy way. 

In the next section, the different information measures 
in the Rasch model will be presented. Then, the mathematical 
relations between the different information measures is 
discussed. As it turns out, all relevant relations are 
consequences of a simple theorem which, loosely speaking, 
states that average conditional information is always less 
than marginal information. The following section gives 
(closed— form) results for the special case of a logistic 
distribution for the ability parameter. Simulated data is 
used to illustrate the results numerically. The last section 
gives some guidelines for selecting an appropriate model. 

Different Information Measures in the Rasch Model 

Fisher's information in the sample for a (scalar) parameter 
of interest ^ is defined as 

(2) I(^) = E^[^ lnL(^;X)] 2 
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where L(^;X) is the likelihood function. Under certain 
regularity conditions (e.g.. Bickel & Doksum, 1977). which 
are usually met. the well-known information inequality for a 
statistic T = f(X) can be derived: 



So. Fisher's information can be thought of as providing a 
lower bound to the variance of a statistic; the less the 
amount of information in the sample, the larger the lower 
bound, and hence, likely', the variance itself. For more 
detailed information, see a standard textbook on mathematical 
statistics . 

As already mentioned, item information in the Rasch 
model depends on the way the ability parameters are treated; 
i.e.. as fixed (possibly unknown) parameters or as 
realizations of a (possibly unknown) rv. These possible views 
on the person parameter as well as their consequences for the 
definition of the item information measure will now be 
considered in more detail. 

First. if the ability parameters 9jj are 

considered as fixed but unknown parameters, information on a 
single item difficulty parameter a is given by 



(3) 



Varp(T) i. 



(4) 



I(o;ei 0n) = I 




Pjo(l-Pjo). 
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where Pj(j is the probability that person j answers an item 
with difficulty a correctly (e.g., Hambleton & Swaminathan, 
1985; Lord, 1980). Note that in this case, for fixed a, 
information is an unknown parameter that can only be 
estimated by replacing 81,...,% by reasonable estimates 
9i,-..»9n- Note that these estimates need not be consistent 
for I-x», though (Fischer, 1974; Haberman. 1977). 

It is a well-known fact that in the Rasch model the 

total score Sj = Xj+ (j=l N) is a sufficient statistic 

for the ability 9 j ^ and that the conditional likelihood given 
Si=si, Sjj=sjj equals 

(5) Lc(ai oj; qi qjlsi s^j) 

= exp(-Zj^^ qiOi)/ nJ^Q y^^iexp{-<si) exp(-<yi)) 

where yj.(expi-Ci) exp(-<yj)) is the elementary symmetric 

function of order r (Andersen, 1980, chap. 6; Fisher, 1974, 
chap. 13 ) , n^ the number of examinees in the sample with 
total score Sj = r and q^ = x^^,, the number of correct 
answers on item i. 

For this conditional likelihood. Fisher's information on 
item difficulty is defined as 

(6) I«Ji!si sjj) = 2^^Q nrPri(l--Pri), 
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where P^i « = l|Xj+ = r) (Fischer. 1974). Note that the 

conditional information in (6) is an observable realization 

of the rv KCilSl SN) . This means that (6) can be used 

for constructing confidence intervals for the item difficulty 
parameter, but not for determining the sample size. 

If the persons taking the test are randomly sampled from 
a certain population, it is reasonable to consider the 

abilities as rea..izations % rv*s S^,.., .,8jj. 

These rv's wixl then be considered as independently and 
identically distributed with density g(9). The density may or 
may not be known, and is usually called the ability density. 
Later the case of a Icrristic form for g(9) will be considered 
in depth; here its form is left unspecified as yet. This new 
look at the aJ^ilities leads to considering the unconditional 
information in (4) as an observable realiration 

l(<s:Qi .....On^ 1(^:91 ©jj), where a is the 

vector of item difficulties (a^ ai). Furthermore, it 

leads to a different information measure. The marginal 
likelihood function is 



N 



(7) L^ia) = n 



n (i+exp(e - c. )) 

i=l ^ 



g(e)de 



The information in this marginal distribution on the 
difficulty parameter a is 
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(8) I(a;g) = J exp(e-<y)[l+exp(e-<i):i'^''g(e)de. 

For fixed a, marginal information will be considered either 
as a known quantity (if g is known) or as an imknown 
parameter (if g is unknown). In the latter case, the 
information measure can be estimated consistently using a 
consistent estimate of the ability density (Engelen, 1987). 
In either case, the information measures can be used to 
construct approximate confidence intervals for o. Only if g 
is (approximately) known in advance, it can be used to 
determine the sample size (van der Linden, 1988). 

Mathematical Relations between Different 
Information Measures 

In the preceding section, three different information 
measures for the item parameters were presented. Naturally, 
the question arises if any relation exists between these 
measures. The answer is positive: The link between these 
measures is provided by the 'ability' paramecer, since a 
different way of treating this parameter leads to a different 
information measure. Two different cases will be considered: 

(1) Bi 8jj are unknown but fixed parameters; and (2) 

83^ 8jj are realizations of 9^^ Q}j with (known or 

unknown) density g(8). 

If Qi 8jj are unknown but fixed parameters, the 

pertinent comparison is between the unconditional information 

Er|c -^2 
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measure KaiBi 9^) in (4) and the conditional measure 

I(o|si, ... . .SN) ia (6) However . the latter depends on the 

observed realization of Sjj; if the same examinees were 

to respond to the same items again, these sufficient 
statistics would likely to take different values. As a 

result, I (a I SI sn) would also take a different value, 

whereas the unconditional information measure I(a;9i 9jj) 

would remain constant. The obvious approach in this case is 
to compare 1(0; 9^ 9jj) with 

Eft [I(a|Sl SN)J 

as a typical value of the former. 

If 9jj are realiza-cions of ©i % with common 

density g, comparisons between all three information measures 
in (4). (6) and (8) setm to be obvious. However, the marginal 
information measure I(a;g) is a constant for each possible 
value of a, v.rhereas the unconditional and conditional 

measures l(o,Qi 6jj) and I(a|si sn) are likely to take 

different values for each realization of 0j^,.. .,0jj- -^iong 
the same lines, it now seems obvious to compare I(a;g) with 
the expected unconditional and conditional information 
measures 

PgtKo;©! ©n)] 

and 

1 
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Eg[I(a|Si SN)] , 

respectively. 

Fundamental to the relations between these different 
(expected) information measures is the following general 
theorem: 

Theorem . Let the random vector X have a density (with respect 

to some or— finite measure) Po-(x) , for <r<=r. Let S=s(X) have 

density fo-(s) and let go.(xls) be the conditional density of X 

given S=s. Finally. let I (or) and I(or|s) be Fisher's 

information about or in the densities P<x(x) and g0.(x|s). 

respectively. Then. 1(a) > E[I(a|S)]. with equality if cind 
d 

only if — In pa(X) and S are uncorrelated. 

OCT 

Proof . We have In Pa(x) = In fa(s) + In g<y(x|s). Thus. 

d 

1(a) = Var[— In Pa(X)] 
do 

d d 
= Var[E(— In Pa(X|S)] + E[Var(— In Pa(X|S)] 
do do 

> E[Var(— In p^(X|S)] 
do 
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= E[Var(— In g^(X|S)] 
= E[I(a|S)] 

d 

Equality holds iff Var{EC— In p^(X)|S)] = 0, that is iff 

d do 

— In P^(X) and S are uncorrelated. ■ 

da 

The theorem immediately leads to the following 
inequalities between unconditional and conditional 

information for the case of 9jj fixed (Proposition 1) 

and between marginal and expected conditional information for 

the case of Qi Pjj as a realization of 01,...,% 

(Proposition 2) : 

Proposition 1 . If Qi 9jj are (unknown but) fixed 

parameters, the expected value of the conditional information 
in (6) cannot exceed the (unknown) unconditional information 
in (4) . that is 

(9) Ee^ Gji [I(a|Si Sn)] ^ KaiGi Gjj) • 

Proposition 2 . If the abilities Bi 9jj are realizations of 

independently and identically distributed rv's 6jj 

with density g(6) . the expectation of the conditional 
information in (6) cannot exceed the (known or unknown) 
marginal information in (8), that is 

ERIC J 5 
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(10) Eg[I(a|Sl 



SN)] s I(a;g). 



The following proposition is a direct consequence of the 
fact that E(E(Y|X)) = E(Y), or, equivalently , that a change 
of the order of integration is permitted. It shows that the 
marginal information measure in (10) may be replaced by the 
expected unconditional measure: 

Proposition 3 . If the abilities Qjn are realizations- of 

^adependently and identically distributed rVs Qi 0jj 

with density g(9) , the expectation of the unconditional 
information in (4) equals the (known or unknown) marginal 
information in (8). that is 



Note again that different 'averaging' takes place in (9) 
and (10) - (11). The latter case will now be explored further 
for a common logistic density for the ability parameters. 



This section consists of three parts. In the first part, 
item information is computed for the marginal model with a 
logistic ability distribution. The second part deals with the 
computation of expected i*.formation for vt*- conditional model 



(11) EgtKa.-ei 



%)] = I(a;g). 



A Comparison of Different Information Measures 



for a Logistic Ability Distribution 
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with the sanie abj.lity distribution. A numerical comparison 
between the two is given in the final part. 

Item Information in the Marginal Model 

Item information in the meirginal model, given by the integral 
in (8). is difficult to evaluate and has to be approximated 
numerically for most choices of g(9) . However, as will be 
shown here, the choice of a logistic distribution function 
permits confutation of the integral in closed form. The 
logistic distribution does not differ much from the normal 
distribution adopted by authors as Andersen and Madsen 
(1977). Sanattianan and Blamenthal (1978). and Thissen (1982). 
The logistic density is given by 

(12) g(e) = p-'exp[-(e-a)/p] [1 + exp[-(e^)/p] 

where a is the mean and P^tc^/S equals the variance of the 
distribution. The logistic density with parameters a and P 
will henceforth be denoted as L(9;a.P). 

Since the Rasch model is not identifiable, a constraint 
has to be imposed on either the location of the ability 
distribution or the item parameters. Because it will be shown 
that this constraint does not lead to severe problems, this 
subject will be dropped for the moment; for convenience, the 
choice p=l is made. Now. (8) can be computed as 
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1(a) = 



expO-c) exp(a-^) 
^ [l+exp(e-o)]^[l+exp(a-8)]^ 



de. 



Sxibstituting exp(9-a) = z and writing exp(a-<T) - t gives for 
1(a) 



00 

T J (1 + Z)"2(Z + T)~\dZ. 



For T = 1, i.e. , a = a, the integrand is (1 + z) z. and it 
follows that 1(a) = 1/6. For x^tl, the integrand is a simple 
rational function, and hence 1(a) can be computed by using a 
fraction formula. For t^I, this leads to 



1(a) = T[(T+l)(T-l)"^lnT - 2(T-1) 2] 



Combining all results leads to 



(13) 1(a) = 



(a-^) 



l+exp((x-a) 



2 



(exp(a-a)-l)3 (exp(a^)-l)2 



1/6 . 



exp(a--a) 
a ^ a 

a = a. 



In order to check the continuity of this result in 
T = 1, the limit for t ~> 1. or. equivalently . for a a. is 
taken, using the Taylor expansion of ln(cxr-a+l) . Writing 
y = T— 1. and substituting 
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ln(y+l) 



= y _ y2/2 + y3/3 + o(y4), 



gives 



lim 1(a) = 
a->a 

lim {(y+l)y-3 [(y+2)(y-y2/2 + y3/3 + o(y4)) 2y] } = 
y->0 

lim (y+l)y^3[y^/6 + oCy"*)]. 



Three different features of (13) can be noticed. First, 
and most important, 1(a) is a function of (X-a only, implying 
that only the difference between the mean of the ability 
distribution and the difficulty of the item is of importance. 
Second, a translation of the ability/difficulty scale does 
not change the result. Third, marginal item information is 
symmetric about zero; substituting -(a-c) for (a-<y) gives 
the same value. Note that the second feature is also a 
property of the Rasch model without the assumption of an 
ability distribution. Together these features show that 
marginal information has only to be computed for the case 
a = 0 and for positive values of the difficulty parameter. 
In Figure 1, for a = 0 the information function in (13) is 



y->0 



Hence, 



lim 1(a) = 1/6. 
a-^a 
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plotted on the interval <-3.3>. Observe the symmetry around 
the y-axis and the nice form of the plot . Larger or smaller 



Insert Figure 1 about here 



values of a only introduce a translation of the graph along 
the X-axis. Some numerical values of (11) for different 
values of a are given in Table 1. 



Insert Table 1 about here 



For comparison with the conditional model, it is noted 
that 1(a) is a function of the difficulty of the item in 
question only, and does not depend on the difficulties of the 
other items in the test. Neither dc is it depend on the values 
of the response variabl<^s realized in the sample. Hence, item 
information in the marginal model, or in the unconditional 
model with sampling o"^ examinees (cf. Proposition 3), can be 
obtained independently of the test by computing (11) as a 
function of a for different values of a. 

Item Information i n the Conditional Model 

Item information in the conditional model (6) is a function 
of nx and Pri- However. 
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(14) Pri = eiY^iJ(e)/Yr(e). 

with = expC-a^), being the ith-order elementary 

symmetric function of the ej^'s, and Yr-1^^^ (r-1 )th~order 
function deleting the parameter of item i (Fisher. 1974. 
chap. 14). Note that the sum in (14) actually ranges from 
r = 1 to r = I-l . because Pgi = 0 and Pj^ = 1. Note further 
that (6) depends on the observed vector (no....»ni) and. 
through (14), also on the difficulties of the other items ^n 
the test. 

Suppose the examinees are sampled from an ability 
distribution with a logistic distribution function L(8;a.P). 
Now. since in each distinct sample of size N the item 
parameters are estimated conditionally on the sample 
distribution of the number-correct score, information on the 
item parameters should be evaluated across sampling. Hence, 
observing that (6) is linear in n^* it follows for the 
expected value of the conditional information that 

(15) EL[I(Oi|Sl.....SN)] = iJ^J Pri(l-Pri)EL(Nr), 

For a fixed examinee with ability 8. the number-right score 
distribution is the generalized binomial with parameters 

P(9i) P(9i) given by (1). which has the moment generating 

function 



T 

(16) (p(t) = n^_^[(Q(ei) + i(ei))e^] 
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with QOi) = 1 - POi) (Kendall & Stuart. 1977, sect. 5.10). 
The average total score distribution with respect to L(6;a.p) 
gives the values of ElCN^) needed to compute (15).^ 

A Numerical Comparison 

Unlike the information function for the marginal model with 
logistic ability in (13), a representation of (15) in closed 
form seems not possible for logistic ability. Hence, in order 
to compare item information in the conditional model with 
information in the marginal and unconditional models, a 
numerical comparison was made. Since the distribution of the 
N^'s in (15) also depends on the number of items as well as 
the distribution of their parameter values in the cast, 
comparisons were Tiade for different cases: Tests with 5 and 
20 items were simulated. The distribution of the item 
parameter values was chosen to be uniform, skewed to the 
right, or normal on the intervals (-3,3), (-3,1), \-l.l) and 
(_5^-4). The last interval was selected to simulate the case 
of an ill-matched, far-too-easy test. To realize the shape of 
the above item parameter distributions as closely as possible 
for a finite number of items, the actual item parameter 
values were chosen to be equal to the expected values of the 
order statistics on the interval of possible values for the 
distributions considered. For example, -2 is the expected 
value of the smallest value in a random sample of size 5 from 
a uniform distribution on (-3,3) (see Table 2 below). 



?2 
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For each of the tests. (15) was calculated by generating 
the abilities of 10,000 examinees from the L(e;0,l) 
distribution. For each examinee the expected distribution of 
total scores was computed using the generalized binomial in 
(16). The average of these distributions over all examinees 
gave the expected total score distribution for the ability 
distribution concerned, i.e., the expected values of the Nj^'s 
in (15). 

TaJDles 2-5 give the results; they show the percentages 
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by which the (expected) information in the marginal and 
unconditional model in (13) exceeds the conditional model for 
the given values of a in the test. For example, for the 20- 
item test with a skewed distribution of the item parameter 
values in Table 2, the items with parameters values -1.85 and 
0.52 yielded values for Fisher's (expected) information 
measure that were 9% and 6% larger for the 
marginal/unconditional model than for the unconditional 
model. From the tables it is clear that for all simulated 
test:5 conditional information was less than marginal or 
unconditional information. The differences were larger for 
the tests of 5 items; the 20-item tests typically resulted in 
differences in the 5-10% range. Also, conditional information 
tended to be relatively large for items with parameter values 

O O 
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close to the mean of the ability distribution. This feature 
Is manifest in each of the tables, but can also be observed 
when the results for tests with parameter values on (-1,1) 
are compared with those on (-3,3). 

It is recalled that in the conditional model, the 
information measure in (15) is not based on response vectors 
with all items correct or wrong; such data are simply 
"conditioned out" by the model. In the marginal model, 
however, all data are used to estimate the item parameters. 
Since the probability of a response vector with all items 
correct or wrong depends on the number of items in the test 
and the distribution of their parameter values relative to 
the ability distribution, the pattern in Tables 2-5 could be 
explained by this ph<»nomenon. Table 6 gives the percentages 



Insert Table 6 about here 



of response vectors with all items wrong or correct. Although 
the percentages resemble the pattern in Tables 2-5, the loss 
of information in the conditional model is not completely 
explained by the loss of data. 

Conclusions 

The general impression from the numerical results is that for 
practical test lengths and distributions of item parameter 
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values that are on target, the loss of information in the 
conditional model relative to the marginal and unconditional 
models is less than ten percent. Roughly speaking, this means 
that for the conditional model the sample sizes have to 
exceed those for the marginal and conditonal models by the 
same percentage to guarantee an equal amount of information. 

The results in this paper suggest the following 
guidelines for selecting one of the three Rasch models 
available : 

(i) If the abilities are considered as unknown but fixed 
parameters, conditional information should be used. This is a 
known function of a whose value depends on the observed 
sufficient statistics in the sample. The unconditional 
information measure is less useful; it depends on the unknown 
abilities, which can not be estimated consistently unless the 
test length also tends to infinity (Haberman, 1977). Since 
conditional information is known only after the data have 
been observed, it can be used to construct confidence 
intervals for the item parameters, but not to determine 
optimal sample sizes. 

(ii) If the abilities are sampled from a distribution with 
unknown density function g, the choice of the proper 
information measure depends on the sample size. Engelen 
(1987) has shown that g can be estimated consistently along 
with the item parameters. Hence, for large samples. 
Proposition 2 suggests the use of the estimated marginal 
measure I(a;g); because of Picposjcion 3, this is equal to 
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th« expected uncondi.tional measure. Again, the information 
measures can only be used to construct confidence intervals, 
not for determining sample sizes. 

(iii) If the abilities are sampled from a knfim density 
function g, Proposition 2 motivates the choice of I(a;g) for 
all sample sizes. Now the information measure can also be 
used to determine sample sizes. 
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Table 1 

Item information in the m arginal model with a logistic 
ability dist:ribution at dif ferent locations. 
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Table 2 

Information in the marginal model r elative to the conditional 
model for distributions of item par ameter values on (-3.3> 



No. of Type of Distribution 
Items 

Uniform Skewed Normal 
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Table 3 

Information in the marginal model re lative to the conditional 
model for distributions of item parameter values on (-^Z.l) 



No. of Type of Distribution 

Items 

Uniform Skewed Normal 
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Table 4 

iCfiformation in the margina l model relative to the conditional 
model for distributions of item parameter values on (-1 ■ 1) 



No . of Type of Distribution 
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Uniform Skewed Normal 
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Table 5 

information in the marginal model relative to the conditional 
model for distributions of i tem parameter values on (-5.-4) 



ilo. of Type of Distribution 
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Table 6 

Percentages of response vectors with all Items correct or all 
jt^^ms incorrect 
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Type of Distribution 
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Figure 

F igure 1 . Item information in 
logistic ability distribution 
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the marginal model with a 
(a=0) 
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